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ABSTRACT 


A  design  optimality  criterion  ^tr(L)^--  optimality^ is  applied  to  the 


problem  of  designing  two-level  multifactor  experiments  to  detect  the  presence 
of  interactions  among  the  controlled  variable  ;.  Rule.-  are  given  for 


constructing  tr(L)  -  optimal  foldover  designs  and  tr(L)  -  optimal  fractional 


factorial  designs.  Some  results  are  given  on  the  power  of  these  designs  for 


testing  the  hypothesis  that  there  are  no  two-factor  interactions. 


Modifications  of  the  tr(^  ~  optimal  designs  to  satisfy  other  experimental 
objectives  ( estimability  of  effects,  detection  of  the  presence  of  other 


nonlinear  effects,  estimation  of  the  error  variance)  are  suggested.  Examples 


are  given  to  demonstrate  the  application  of  these  designs  to  (i)  screening  for 


interactions,  and  (ii)  evaluating  the  first-order  assumption  in  the 


sensitivity  analysis  of  a  computer  code, 
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An  *  -io 


SIGNIFICANCE  AND  EXPLANATION 


Experiment  designs  (plans)  in  which  each  controlled  variable  (factor)  can 
take  one  of  two  specified  levels  are  frequently  used  in  the  initial  stages  of 
an  experimental  investigation,  when  the  objective  is  to  determine  which 
factors  are  important  and  how  they  interact.  This  paper  is  concerned  with  the 
design  of  such  two-level  experiments  to  detect  the  presence  of  interactions. 

It  is  shown  here  how  this  can  be  done  with  very  few  experimental  trials 
(runs),  even  when  the  number  of  factors  under  investigation  is  large. 


Our  approach  is  to  define  an  "optimality"  criterion  which  represents  the 
ability  of  a  design  to  detect  the  presence  of  interactions.  This  is  based  on 
the  trace  of  a  matrix  that  depends  on  the  design.  We  then  determine  rules  for 
constructing  designs  that  ma'  icize  this  quantity,  over  two  broad  classes  of 
two-level  experimental  designs.  The  main  drawback,  from  a  practical  point  of 
view,  is  that  the  focus  on  a  single  criterion  may  result  in  the  neglect  of 
other  design  objectives.  We  therefore  present  some  modifications  which 
improve  the  designs  with  respect  to  other  criteria. 


The  designs  presented  here  have  application  to  any  experimental  situation 
in  which  there  is  some  doubt  as  to  whether  the  controlled  variables  act 
independently  on  the  response  or  whether  they  interact.  A  particular 
application,  which  is  demonstrated  in  an  example  in  the  paper,  is  to  the 
sensitivity  analysis  of  computer  codes  which  are  used  to  model  physical  or 
economic  systems. 
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1 .  Introduction 


1.1.  The  Problem 
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TWO-LEVEL  MOLT I FACTOR  EXPERIMENT  DESIGNS  FOP  DETECTING 
THE  PRESENCE  OF  INTERACTIONS 

+  ** 

Max  D.  Morris  and  Tobv  J.  Mitchell 


We  consider  here  the  problem  of  designing  two-level  experiments  no  detect  the  prese-ce 
of  interactions  among  k  experimentally  controlled  variables  (factors)  Xi ,X2, • • • ,Xy , 
with  respect  to  their  effect  on  the  expectation  n  of  a  randomly  distributed  response 
variable  yx«  There  are  no  interactions  over  a  specified  region  of  interest  x  if  and 
only  if  h  can  be  expressed  as 


n  =  n(x)  =  f^x^  +  f2(X2)+...+fk<Xk) 


;i.i) 


for  suitably  chosen  functions  f ^ )  when  X  =  (X1  ,X2,  •  •  •  ,X.K>  e  X’ 

We  shall  restrict  attention  to  just  two  levels  of  each  factor:  X^  and  Xj*,  cnose- 
so  that  all  2k  combinations  of  levels  are  in  x.  and  we  shall  define  the  "coded" 
factors  x^  ,x2, . . .  so  that  x^  =  -1  when  X^  =  Xj  and  x^  =  +1  when  X;  =  X,  • 
shall  denote  the  2k  corners  of  the  cube  x^  =  ±1  by  (C.  In  terms  of  the  coded  'actors, 
(1.1)  becomes 


n(x)  =  6.  +  5.x. 

0  i="l  1  1 
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x  -  (x,  .x^, . . ,  ,xk)  e  K  ,  whoro  *•  (  f  J  ( X  ( )  -  f  (X  "))/2,  l  - 

i *  vxi'”' 

1-1 

A  nlmplo  departure  from  (1.1)  allow*  pairwise  interaction*,  i.e., 


1,2,  ...  /  k,  nn<1 


n  can  bn  expressed 


a* 

k-1  k 

n( x)  -  l  l  f  (X  ,x  )  .  d.3) 

i-i  j-i+i  13  1  3 


In  term*  of  the  coded  factor*,  (1.3)  can  he  written 


k  k-1  k 

n(x)  -  8.  +  l  8.x  +  J  l  8, ,x  x  (1.4) 

i-1  i-1  j-i+1  X3  1  3 

for  x  e  X  .  This  is  a  conventional  model  for  the  analysi*  of  2-level  factorial 
experiments  (possibly  incomplete)  in  which  interaction*  among  three  or  more  factors  are 
assumed  to  be  zero.  We  shall  use  it  here  in  a  somewhat  different  way,  namely,  as  a  device 
for  the  planning  of  experiments  to  indicate  whether  or  not  the  factors  affect  the  response 
independently,  i.e.,  as  in  (1.1).  Our  approach  will  be  to  assume  that  (1.4)  holds  on  K  , 
then  to  use  a  design  optimality  criterion  to  construct  designs  which  will  bo  good  for 
detecting  the  presence  of  non-zero  8^'s.  Even  if  higher  order  interactions  are  present, 
we  would  expect  this  approach  to  work,  since  (1.4)  will  be  a  better  approximation  to  the 
true  response  over  K  than  will  (1.2).  We  should  also  emphasize  that  wo  do  not  expect  nor 
require  (1.4)  to  hold  outside  of  K  .  (If  n  is  a  quadratic  polynomial  over  some 
continuous  region  of  interest  which  contains  K  ,  for  example,  (1.4)  holds  on  K  but  not 
everywhere  in  the  region.) 

In  this  paper,  we  shall  refer  to  the  fl^'s  ^ 1 ■ 4 )  8S  "interactions"  and  the 

R^'s  (i  y  0)  ns  "main  effects".  Except  for  a  factor  of  2,  these  are  the  same  as  the  main 
offocts  and  interactions  conventionally  defined  for  a  two-level  factorial  experiment  (box 


and  Hunter  (1001)). 


flood  don l <inn  the  Resolution  V  fractional  factorials)  exist.  for  estimating  the 

main  effects  a n<1  Interactions  In  the  model  (1.4).  However,  tho  number  of  rune  required  la 
nt  least.  (V  +  k  +  2)/2,  and  may  bo  conaiderably  greater  than  that  If  a  regular 
fractional  factorial  design  lo  used. 

In  thin  paper,  wo  conoidor  a  loan  ambltioua  experimental  goal,  namely  to  determine 

whether  or  not  significant  interactions  are  preaent.  Such  information,  obtained  early  in 

an  investigation,  can  ho  useful  In  planning  subsequent  experiments.  Initially,  we  shall 

ignore  other  conuideratinns ,  ouch  as  aatimahility  of  the  main  effects  and  interactions  and 

2 

estimabi lity  of  tho  error  variance*  o  .  These  will  he  discussed  in  Section  5. 

1.2.  A  Dontgn  Criterion;  tr(jj)  -optimality'  . 

In  matrix  notation,  our  model  {for  a  vector  £  of  n  observations,  based  on  (1.4), 

Is  i 

l  •  +  £2£2  +  £»  *(£)  -  0.  v<£>  ■  i°2  f1*5’ 

whore  is  tho  (k  +  1 )-vector  (CQ  ,3^ , • • • ,3^) '  and  jg2  is  the  kj-vector 

( (5,  .  ,15, . , . . .  ,B.  >'  of  interactions,  with  k,  ■  k(k-1)/2.  The  matrices  X  and  X 

Ilia: 

depend  through  (1.4)  on  tho  n  x  k  design  matrix  D,  whose  uth  row  is 
( x1u ' x2u' ’ ’ ’ 'xku} ' 

When  the  model  ( 1 .  •> )  is  fitted  using  the  ordinary  least  squares  criterion  under  the 

restriction  that  £2  »  0,  the  expected  residual  sum  of  squares  in 

RRSS  -  (n-rtX^lo2  +  £'LJJ  (1.6) 

where  r(X.)  is  the  rank  of  X,  and  the  lack-of-fit  matrix  I.  is 
~1  -1  -» 

h  -  X^(X  -  X^X^X,)"^'  )X2  .  (1.7) 

Wo  shall  not  require  to  ho  nonsingular,  hence  the  use  of  the  generalized  inverse 

(XIX,)"  in  (1.7). 

■'1"1 

Atkinson's  (1772)  general  approach  to  tho  problem  of  detecting  Inadequacy  of  the  model 
E(y)  “  X.3.  wan  to  select  the  design  so  as  to  maximize  the  determinant  of  I,  or 
equivalently,  to  minimize  tho  generalized  variance  of  the  least  squares  estimator  of  (1^. 


-.1 


This  criterion  can  be  applied  only  within  the  class  of  desions  for  which 


estimable.  Our  approach  nere  will  be  more  closely  related  to  the  work  of  Atkinson  and 
Fedorov  (1975),  whose  T-optimality  design  criterion  reduces  to  the  naximizatio'  of 
X  =  3;lS2.  This  criterion,  however,  depends  upon  the  value  of  whicn  is  unknown. 

Jones  and  Mitchell  (1978)  avoided  oiis  difficulty  by  utilizing  the  relationship  between 


X  and  the  posit-i'.'o  .^finite  quadratic  form  T  =  B^Tj^,  which,  with  proper  choice  of  7, 


can  be  interpreted  as  a  measure  of  the  importance  of  the  interaction  terms.  One  of  their 


criteria  (.^-optimality)  requires  maximizing  the  average  value  of  X  (over  2.,)  for 


-1 


constant  t;  this  is  equivalent  to  maximizing  tr(T  L).  In  the  present  setting,  the 

Jones-Mitchell  T-matrix  can  be  shown  to  be  the  identity  I,  so  .'^-optimization  becomes 

'w  2 

maximization  of  the  trace  of  L.  In  Appendix  A,  we  show  that  the  tr(L)  criterion  can 


also  be  derived  by  maximizing  the  expectation  of  X  (no  matter  what  the  value  of  is' 


under  random  assignment  of  factor  labels  and  factor  level  labels.  This  is  the  criterion  we 
shall  adopt  in  this  paper. 


1.3.  Conventions  and  Notation. 


Throughout  this  paper,  the  word  "design”  refers  to  a  two-level  design,  except  for  a 
brief  discussion  of  "center  points"  in  Section  5.3.  When  we  wish  to  indicate  also  the 
number  of  runs  (n)  and  the  number  of  factors  (k),  we  shall  write  " ( n,k)-design" . 


The  following  is  a  selected  list  of  letters  and  symbols  used  in  tne  text, 
k:  Number  of  factors. 

Number  of  two-factor  interactions  =  k(k-1)/2. 

K:  Set  of  2^  possible  combinations  of  levels  of  the  coded 
factors  x, ,x2, . . . ,x^,  where  x)  =  il . 
r.:  Number  of  runs  in  a  design. 

n:  Number  of  runs  in  the  "half-design"  used  t~  construct  a  foldover 
a:  Integer  value  of  k^n. 
r:  Remainder  upon  dividing  k  by  n. 
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I 


I 


3 


v: 

s 
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I 


I 
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1 1 

;  l 
*  ^ 
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*  i 


‘1 


rfl 


,  V) 


D:  Design  matrix . 

D:  Des-gn  matrix  for  the  "half-design". 

8,:  Vector  of  coefficients  for  the  first-order  model  {8_ ,2. . . . . ,3.  )• 

~1  0  1  x 

Vector  of  interaction  coefficients  (S_.. ,2., ». •  •  ,3.  .  ). 

-2  11  12  k-1,k 

K _ ;  Matrices  of  known  constants  in  the  model  E(y)  =  X.3,  ♦  X„2_. 

-2  "•  **1**1  -2~2 

L:  Lack  of  fit  matrix  L  =  XIX.  -  XiX.tX'X ,)“x’X-. 

*»  ~  ~2~2  ~2~1  ~1~1  ~1~2 

2 

a  :  Common  variance  of  the  individual  observations  (v^*s). 
n^s  fjmber  of  words  of  length  i  in  the  defining  relation  of  a 
fractional  factorial  design. 

q;  Numbe-  of  strings  of  aliased  two-factor  interactions  (not  counting 
the  string  that  is  confounded  with  the  overall  mean)  in  a  fractional 
factorial  design. 

w:  Likelihood-ratio  statistic  for  testing  the  hypothesis  that  2  =  0. 


2.  The  Structure  of  Tr(L)-Optimal  (n.kl-Desions 
2.1.  Orthogonal  Arrays  of  Strength  3 

It  is  clear  from  (1.7)  that  tr(L)  cannot  exceed  tr(X^X2)  =  nk^ ,  and  that  this 
upper  bound  is  attained  exactly  if  and  only  if  X.^  =  0.  This  condition  can  occur  if  a-J 
only  if  all  design  moments  of  form  li],  (ijl ,  and  Siji)  are  zero,  where 

1  n  n  n 

[i)  =  -  l  x.  ,  tij)  =  -  l  x  x.  ,  !ij£)  *  -  x  x.  x.  .  -I-1' 

n  iu  n  L .  in  iu  J  n  iu  iu  iu 

u=1  u=1  u=1 

This  in  turn  can  hold  if  and  only  if  every  subset  of  three  columns  of  the  desicn  matrix  ~ 
forms  a  complete  23  factorial  design  (possibly  replicated),  i.e.,  D  is  an  ort'-cn — ■>" 
array  of  strength  3.  We  therefore  have  the  following  theorem: 

Theorem  2.1.  If  n  is  a  multiple  of  «  and  there  exists  an  orthooor.al  nr’-a'-  o* 
strength  3  in  n  runs  and  k  variables,  then  the  set  of  all  such  ortboaor.a!  arravc  is 
set  of  all  tr  (L)-optimal  (n,k)-desians.  (An  extended  version  of  this  theorem,  arrl : -eh 
to  a  general  "actorial  setup,  appears  in  Morris  and  Mitchell  f  1  ,  no.  40-551,1 


The  orthogonal  arrays  of  tho  type  declared  optimal  by  the  ahovo  theorem  run  easily  be 
constructed  by  "foMlng  over"  an  orthogonal  main  effects  design,  o.q,  a  Piackett-hurman 
(1946)  dcnlnn  or  a  regular  fractional  factorial  design  of  renolutlon  ITT  (Dox  and  Hunter 
(1961)),  The  latter  'o  Mover  designs  are  momhors  of  the  familiar  class  of  regular 
fractional  factorial  designs  of  resolution  TV. 


2.2.  Pol  Hover  Pen  Inns  and  Tr(ti) -Optimal  tty i  A  Conjecture 

Wo  now  turn  to  values  of  n  and  k  for  which  no  orthogonal  array  of  strength  .1 
exists.  These  Include  all  cases  In  which  n  <  2k  or  n  is  not  a  multiple  of  8. 

Our  first  attempt  at  the  construction  of  tr (L)-optimal  designs  in  these  situations 
was  a  limited  computer  search  in  which  we  used  the  design  construction  algorithm  DPTMAX 
(Mitchell  (107.1a)),  modified  for  our  purposes  to  find  locally  tr(L)-optimal  designs. 
Designs  were  generated  for  k  *  4  with  n  ■  6/8,10,  and  12,  and  for  k  «  5 
with  n  «  8,12,16,20,  and  24.  In  every  case,  the  design  with  maximum  tr(L)  turned  out  to 
be  a  foldovcr  design,  i.e.  tho  design  matrix  D  could  be  written  as 


(2.2) 


where  the  "half-design"  matrix  1)  is  an  n  x  k  matrix,  n  "n/2. 

Foldover  denlons,  Introduced  by  nox  and  Wilson  (1951),  have  proved  to  be  extremely 
useful  for  estimating  main  effects  free  of  bias  from  two-factor  interactions.  The  results 
of  our  computer  search  indicated  that  this  clnon  of  designs  may  also  be  "optimal"  for 
detecting  the  presence  of  two-factor  interactions.  We  express  this  specifically  in  the 
following  conjecture,  which  we  have  not  been  able  to  prove. 


Conjecture •  For  '•ven  n,  a  foldover  d«-,1qn  exists  that  is  tr (T. )-opt.lmal  ‘n  the 

i  r.  dvflned  an  In  (1.7)  for  tho  modol  (1.5), 


class  of  ( n , k )-desi uns,  where 


t. 


Although  tr (L)-optlmal  designs  for  even  n  are  not  naeaaaarllv  foldovers  (witnaaa  th# 
raaolution  V  fractional  factorial  designs),  tha  conjactura  impliaa  that  ona  naad  only 
search  tho  class  of  foldovers  to  find  a  tr(L! -optimal  design.  This  is  what  wa  shall  do 
next . 


2.3  Tr(L) -Optimal  Foldover  Designs 

Some  simple  matrix  algebra  shows  that  for  a  foldovar  design  (2.2)  and  for  the  model 
defined  by  (1.5), 


tr(L)  -  nk2  -  n"1  tr(D'D)2  (2.3) 

**  **  2 

Thus  tho  tr(L)  criterion  for  design  selection  is  equivalent  to  minimising  tr(J)'D)  , 
which  is  Shah's  (1960)  criterion  applied  to  a  first  order  model  with  no  constant  term. 
(Also,  see  Kiefer  (1974),  Section  4H.)  Thanks  to  some  unpublished  results  of  L.  J.  Gray 
and  some  helpful  conversations  with  C.  S.  Cheng,  an  optimal  D  can  be  constructed  easily 
by  referring  to  tho  following  rules,  derivations  of  which  are  given  in  Appendix  B. 

*v 

Gray-Cheng  Rules  for  Constructing  D  (n  j>  k) 

Case  1 1  n  5  0 [mod  4] . 

Choose  D  to  be  a  column-orthogonal  n  x  k  matrix.  Examples  most  familiar  to 
statisticians  are  the  Resolution  III  two-level  fractional  factorials,  and  the  Plackett  and 
Burman  (1946)  designs. 

^a 

Case  2 i  n  2  1 [ mod  4 1 . 

Add  any  row  with  elements  il  to  a  column-orthogonal  (n-1)  x  k  matrix. 

Case  3 i  n  3  2 [ mod  4 ] . 

*v 

fa)  If  k  <  n-2,  augment  an  ( n-2 )  x  k  column-orthoqonal  matrix  with  two  rows  of 
«1'u  end  -I'n,  chosen  so  that  the  absolute  value  of„  their  inner  product  is  less  than  or 

equal  to  1. 


7 


r.  or  K  =  n-1 


x  t- 


l  S»  it  <  =  n  or  x  =  n-1 ,  remove  from  an  (n<-2)  *  k  colut 
rows  whose  inner  product  has  absolute  value  less  than  or  equal  to 
shown  that  two  such  rows  exist. 

Case  4:  n  S  3 [mod  4] . 

Remove  any  row  from  an  (rs+1)  x  y  column-orthogonal  matrix. 


:r.-crthogor.al  matri 
1.  In  Apner.dix  3,  it 


The  Grav-Cheng  rules  can  be  applied  in  virtually  all  cases  of  practical  interest, 
the  exception  of  the  case  k  =  n  =  1  (mod  4),  where  the  column-orthogonal  (n-l)  »  >. 
matrix  required  by  the  rule  for  Case  2  does  not  exist.  (See  Raahavarao  (1959)  for  special 
constructions  when  n  =  5,  13,  or  25. 

Remark  1 .  Since  tr(D'D)  =  tr(DD')*",  the  sane  rules  can  be  used  when  n  <  k:  we 
simply  transpose  an  optimal  k  x  n  matrix. 

Renark  2.  The  tr(L)-optiraal  foldovers  derived  from  these  rules  are  not  unicue. 
Usually  there  are  several  ways  to  choose  the  basic  column-orthogonal  matrix  and  several 
ways  to  add  or  remove  one  or  two  rows  according  to  the  rules.  These  may  yield  different 
h  (but  the  same  tr(L) )  when  folded  over. 

Remark  3.  In  Cases  1,2,  and  4,  the  class  of  foldover  desiems  derived  from  t-.e  Gray- 
Cheng  rules  is  the  same  as  the  class  of  designs  obtained  by  folding  over  the  x  matrix 
(including  the  column  of  1's'  for  designs  constructed  according  to  the  rules  giver,  by 
Mitchell  (1974b)  to  achieve  D-optiraality  (in  most  cases)  for  the  first-order  model. 

Case  3  there  are  some  minor  differences.  R'e  would  therefore  expect  the  tr'T. '-optimal 
foldovers  to  be  good  for  fitting  the  first-order  model  (when  n  >  2k)  if  interactions  a-- 
found  to  be  negligible. 

Upper  bounds  on  tr(t.)  for  foldover  designs  are  easily  obtained  by  substit  "tnc  in*  ' 
(2.3)  the  minimum  tr(C*D)^  given  in  Appendix  S.  These  bounds,  which  are  sxven  in  Table 
2.1,  are  attainable  hv  all  foldovers  derived  from  the  Gray— chenc  rules. 


n  >  k 


n  «  k 


n  ( mod 


4) 


0 

1 


2,k  even 

2  ,k  odd 

3 


tr(Jj)  kfmod  4) 

nk(k-l)  0 

nk(k-1 )(1-n"2)  1 

nk(  k-1 ) ( 1  -  2(k-2)(k-1)"1n"2)  2,n  even 

nk(k-l  )(1-2(k-1)k-1n"2)  _2,n  odd 

nk(k-1 ) ( 1 -n"2 )  3 


tr(L) 

<v 

k  ^ ( n- 1  ) 

(k2-1)(n-l) 
k2(n-1 ) -2  f n-2 ) 

k.2  ( n-1 ) -2  f n- 1 )2n_1 ) 
(k2-1 )(n-1 ) 


Table  2.K  Upper  bounds  on  tr(L)  for  foldover  designs  in  k  variables 
and  2n  runs.  These  hounds  are  attained  by  all  designs  derived  from 
the  Gray-Char. j  rules. 


3.  Tr(L) -Optimal  Fractional  Factorial  Designs 

Since  the  fractional  factorial  designs  are  so  well  known  and  widely  used,  it  is  of 
interest  to  know  which  are  the  best  with  respect  to  the  tr(L)  critorion,  and  how  those 
compare  with  the  optimal  foldovers  described  in  the  previous  section.  We  shall  restrict 
our  discussion  to  the  regular  fractional  factorials.  Evory  design  in  this  class  has 

a  unique  ''defining  relation"  with  2P-1  "words"  which  identify  the  effects  that  are 
completely  confounded  with  the  overall  mean  (Box  and  Hunter  (1961)). 


3.1.  Characterization 

From  Theorem  2.1  and  Theorem  C2  in  Appendix  C,  we  can  characterize  tr (L)-optimal 
fractional  factorial  designs  as  follows i 

1.  If  n  >  2k,  the  tr (L)-optimal  fractional  factorials  are  the  2'"15  deslans 
of  resolution  >4. 

2.  If  n  <  2k,  the  tr(L)-optimel  fractional  factorials  are  the  2^"^  foldover 
designs  of  resolution  2  with  the  fewest  2-letter  words  in  the  defining  relation. 


3.2  Construction 

The  construction  of  desicns  of  resolution  >4 — in  well  known,  so  there  is  no  oroMn-' 
if  n  >  2k,  unions  one  wants  to  use  additional  criteria  to  select,  from  amone  the  ran" 
designs  available.  For  this  purpose,  we  would  recommend  the  "minimum  aberration"  ov  Iter 
of  Frlon  and  Hunter  (1979),  which  In  the  present  case  amounts  to  selectinu  do  .Menu  'Hi 


Best  Available  Copy 


W?ri 


SMflajsagt 


have  the  fewest  words  of  lenqth  4  in  the  defining  relation.  fSee  Appendix  D  for  a  more 

detailed  discussion.)  Table  12.15  of  Box,  Hunter  and  Hunter  (197?)  gives  a  list  of  minimum 

aberration  designs  for  k  <  11,  n  <  128. 

If  n  <  2k,  we  want  to  construct  the  2k-D  foldover  with  the  fewest  words  of  length 

2  in  its  defining  relation,  i.e.,  with  the  fewest  pairs  of  completely  confounded  factors. 

This  can  be  achieved  only  by  distributing  the  factors  as  evenly  as  possible  over  the  set  of 

* 

columns  in  D  ,  the  saturated  design  of  resolution  >4  in  n  =  n/2  factors  and  n 
★  2  4-1  £-4  16-11 

runs.  (Examples  of  D  are  the  2  ,  2  ,  2JV  and  2Jv  designs.  See  Box  and  Hunter 

(1961),  Section  5.)  The  tr(L) -optimal  designs  will  therefore  have  the  form 

•  * 

(Di-02Jf  where  consists  of  a  >  1  copies  of  D  and  consists  of  a  subset  of 

★  ^ 

r  distinct  columns  of  D  ,  and  where  a  and  r  are  the  integer  part  of  k/n  and  the 

remainder,  respectively: 


a  =  Int(k/n) 


r  =  k  -  an 


For  construction  and  analysis,  it  is  convenient  to  write  these  designs  m  terms  of 

"group-factors"  A1,A2,...,A^  (Watson  (1961)).  An  example,  for  k  =  12  and  n  =  8,  is 

n 

given  m  Table  6,1  of  Section  6.  The  aliasing  relations  can  then  be  determined  most  easily 
by  first  writing  down  the  n  aliasing  relations  among  the  group  factors  in  the  usual  way: 


(l)  replace  each  group-factor  main  effect  A^  by  the  sum  of  the  main  effects 
of  the  factors  in  Group  A^ ; 

fii)  replace  each  two-factor  interaction  (AjA. )  among  ciroun-factors  hv  the 
sum  of  all  two-factor  interactions  involvmo  one  factor  from  group  A 
and  one  factor  rtom  groom  ,\^ ,  ^nd 


(ni)  replace  the  overall  mean  (denoted  by  I  in  the  notation  of  Box  and  Hunter 
(1961))  by  3^  plus  the  sum  of  all  two-factor  interactions  involving 
two  factors  from  the  same  group. 

•v  it 

For  tr(L)  optimality,  it  doesn't  matter  which  r  of  the  n  columns  of  D  are 
chosen  to  form  .  However,  if  we  regard  as  an  n-run  design  in  r  factors,  and 

choose  it  to  minimize  the  sum  of  squared  lengths  of  the  strings  of  two-factor  interactions 
among  those  factors,  then  the  design  D  =  { D ^ I D ^ }  will  have  minimum  aberration  among 
tr(L)-optimal  2^”^  designs.  (This  is  Theorem  D1  in  Appendix  D. )  The  construction  of 
such  D,,  is  easy  when  r.  =  4,8,  or  16;  any  subset  of  r  columns  of  D*  will  do.  When 
n  =  32,  proceed  as  follows: 

]  A-»  1  1 

(l)  Write  down  the  saturated  2  design  with  generators  1236,  1247,  1258,  1349, 

135(  10),  145(1  1  ),  234(12)',  235(13),  245(14),  345(15),  12345(16). 

(ii)  Strike  out  the  columns  associated  with  the  first  (16-r)  factors  in  the 
following  list:  16,  IS,  14,  13,  12,  1,  11,  10,  7,  6,  9,  5,  4,  3,  2. 

This  procedure  was  derived  by  writing  down,  for  each  k,  all  feasible  integer  vectors 

( f 0  ,f 1 ,  f 2<  •  •  • ) ,  where  f^  is  the  number  of  strings  of  length  i,  finding  the  one  which 
v  2 

minimizes  ’if.,  and  then  finding  the  corresponding  design.  We  have  not  attempted  to 
derive  similar  procedures  for  n  >  32. 


3.3.  Comparison  of  Tr(L)-<)ptinal  Fractional  Factorials  With  Tr(L) -Optimal  Holdovers. 

When  n  is  a  power  of  2,  one  would  generally  prefer  to  use  a  fractional  factorial 
design  rather  than  the  less  familiar  optimum  foldovers  of  (lection  2,  mainly  for  reasons  of 
simplicity  of  construction  and  analysis.  As  we  shall  now  see,  the  optimal  fractional 
factorials  are  either  as  good  as  or  "almost"  as  good  as  the  optimal  foldovers  with  respect 
to  tr(L)-optimal ity. 

If  n,  a  power  of  2,  is  greater  than  or  eoual  to  2k,  the  tr (L)-optinal  fcldovers 
and  the  tr(I.)-oot imal  fractional  factorials  are  othooonal  arrays  of  strength  3,  and  so  are 
optima1  among  ( n,'-  )-desions  hv  Theorem  2.1.  In  the  more  interesting  case  n  <  2k,  our 
mam  result  (Ti'-orem  C"1  of  Aonendix  '"i  is  as  follows: 


-  1  1  - 


I 
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Given  n  (a  power  of  2)  and  k  >  n  =  n/2,  a  tr(L)-optimal  2,<”p  design  in 


n  runs  is  tr(L)-optimal  among  all  two-level  foldover  ( n ,k )-designs  if  and  only  if 


r  (the  remainder  upon  dividing  k  by  n)  is  0,1,2,n-l,  or  n-2. 


In  the  cases  for  which  r  does  not  satisfy  these  conditions,  the  tr(L)-optimal 


?.p  design  is  "almost"  optimal  among  foldovers.  For  example,  suppose  r  =  n/2,  where 


n  >  8,  which  appears  to  be  the  "worst  case"  for  the  efficiency  of  the  2^_p  designs 


with  n  <  2k.  Since  n  is  a  power  of  2  and  n  >  8,  k  is  divisible  by  4  (by  (3.2)), 


so  the  upper  bound  on  tr(L)  for  foldover  designs,  given  in  Table  2.1,  is  k“(n-i).  The 


efficiency  of  the  optimal  fractional  factorial,  relative  to  this  upper  bound,  can  be  shown 


~2  2  "  ~  -  ~ 
to  equal  1  -  n  /(4k  ( n— 1 ) ) .  For  fixed  n,  this  is  minimized  when  k  =  r  +  n  =  3n/2. 


(See  (3.2).)  Thus  the  efficiency  of  the  optimal  fractional  factorial  is  at  least 


1  -  (9(n-1))  ,  which  is  at  least  .9841,  since  n  >  S  here. 


We  conclude  that  if  one  is  seeking  a  tr(L) -optimal  (or  nearly  optimal)  foldover 


in  2n  runs  where  n  is  a  power  of  2,  one  might  as  well  restrict  attention  to  the 


fractional  factorials.  These  designs  are  easy  to  construct  and  the  analysis  of  the  data  is 


easier  to  perform  than  for  other  types  of  tr<L)-optimal  designs. 


4.  Power  of  the  Likelihood-Ratio  Test  of  the  Hypothesis  of  No  Interactions 


In  this  section,  we  shall  indicate  roughly  the  ability  of  the  designs  of  Sections  2 


and  3  to  detect  the  presence  of  interactions  when  a  conventional  statistical  hypothesis 


test  is  used. 


4.1.  The  LR  Test  for  the  Presence  of  Interactions. 


We  shall  restrict  attention  here  to  two  studies  of  the  power  of  the  likelihood-ratio 


(LR)  test  of  the  hypothesis  that  =  0  in  the  model  (1.5),  where  £  is  nornallv 


distributed  and  c  is  assumed  "known".  This  is  not  intended  to  preclude  the  use  of  or- 


forma?  or  informal  techniques  of  analyzina  the  data  for  the  presence  of  mteractie-s. 


-12- 


The  LR  test  statistic  w  is  R(8_lB.)/o  ,  where  R(S„|B.)  is  the  increase  in  t*e 

~2  ~2  ~l 

residual  sum  of  squares  for  the  model  (1.5)  that  results  when  is  set  to  0.  This 

statistic  has  a  non-central  chi-squared  distribution  with  r(L)  degrees  of  freedom  and 

2 

non-centrality  parameter  X/(2d  ),  where  r(L)  is  the  rank  of  L  and  X  = 

The  calculation  of  the  LR  statistic  w  is  particularly  easy  for  the  foldover 
designs  of  Sections  2  and  3  when  n  <  2k.  Let  y^+  and  y^-  be  one-ha  f  the  sun  and 
one-half  the  difference,  respectively,  of  the  two  observations  in  the  i  ;h  foldover 
pair.  Then  an  equivalent  form  of  the  model  (1.5)  is 


E<X  >  -  I80  +  ~2&2  E(X  >  =  26i* 


M.1) 


where  D  and  are  composed  of  the  columns  for  main  erfects  and  interactions, 

respectively,  in  the  half-design,  and  our  notation  has  been  changed  temporarily  so  that 

61  now  contains  only  main  effects  (not  BQ ) .  Note  that  the  elements  of  y+  and  y 

2  ~ 

are  all  uncorrelated  and  have  variance  a  /2.  When  the  half-design  D  has  full  row  rank 
n  =  n/2,  as  it  does  for  the  foldovers  of  Sections  2  and  3  with  n  <  k,  there  is  no 
contribution  to  the  residual  sum  of  squares  from  y  ,  i.e.,  y  =  y  .  It  therefore 
follows  that  the  residual  sum  of  squares  for  the  model  (4.1)  with  &2  =  0  is  just  the  sum 
of  squared  deviations  of  the  y^'s  about  their  average.  This  residual  sum  of  squares  is 
in  fact  since  the  row  rank  of  [I^X,]  is  also  n,  and  the  unrestricted  moiel 

fits  the  data  exactly.  Thus 


w  =  2^(yj-y+)2/o2 


for  the  designs  of  Sections  2  and  3  with  n  <  2  k . 
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•J.2.  Pc we r  Study _ 1_ 

This  was  -  '‘".MjaHon  study  which  was  conducted  for  some  tr(L) -optimal  foldover 
designs  constructed  as  indicated  ir,  Section  2.  Cases  examined  were  k  ■=  3  through  R 
with  n  =  4,6,  and  6. 

For  each  design,  the  power  of  the  TP  test  was  investigated  tor  two  values 
2  2  2 

of  p  =  B^Sj/o  ,  where  ;  may  be  viewed  as  a  measure  of  the  overall  magnitude  of  the 

interactions.  (b'e  note  that  is  the  average  squared  residual  per  point  which  would 

occur  if  the  first-order  model  were  fitted  to  the  "true"  resoonse  (1.4)  over  K.  Thus,  for 

2 

example,  if  the  interactions  are  such  that  o  =4,  we  would  expect  a  "typical"  deviation 
from  the  first-order  model  at  a  given  combination  of  factor  levels  to  be  on  the  order  of 


In  each  simulation,  2^  was  selected  randomly  12,500  times  from  a  uniform 

2  2 

distribution  on  the  sphere  =  0  0  #  (o  =  1.0  or  2.0),  according  to  a  method 

described  by  Marsaglia  (1972).  For  each  6,,  the  non-centrality  parameter  was  computed, 
then  the  corresponding  power  for  the  LR  test  at  the  a  =  .10  level  was  calculated  usina 
an  approximation  to  non-central  chi-squarod  probabilities  aivon  by  Severo  and  Helen 
(1960).  This  procedure  generated  a  distribution  of  power  values,  the  criartiles  of  which 
are  given  m  Table  4.1  for  each  case. 


k 

n 

y.25 

P.50 

P.73 

P.25 

?.50  V.7S 

3 

4 

.217 

.455 

.652 

.543 

.949  .987 

6 

.528 

.675 

.784 

.986 

.999  1.00' 

8 

.767 

.767 

.767 

1.C00 

1.000  1.000 

4 

4 

.189 

.420 

.661 

.447 

.924  .998 

6 

.445 

.644 

.787 

.955 

.998  1.000 

8 

.624 

.766 

.863 

.998 

1.000  1.000 

5 

4 

.178 

.382 

.631 

.409 

.887  .996 

6 

.387 

.593 

.751 

.910 

.995  1.000 

8 

.549 

.711 

.831 

.992 

1.000  1.000 

6 

4 

.176 

.290 

.483 

.401 

.736  .963 

6 

.364 

.576 

.742 

.884 

.993  1.000 

8 

.519 

.694 

.824 

.987 

1.000  1.000 

7 

4 

.169 

.367 

.621 

.376 

.869  .995 

6 

.359 

.577 

.740 

.877 

.993  1.000 

8 

.510 

.690 

.921 

.985 

.999  1.000 

8 

4 

.181 

.369 

.634 

.421 

.871  .996 

6 

.362 

.582 

.752 

.882 

.994  1.000 

8 

.517 

.702 

.834 

.986 

1.000  1.000 

Table  4.1 

.  Power 

study  for  small  tr(L)- 

-optimal 

foldovers:  ouartiles 

of  the  distribution  of  the 

power  of  the 

LR  test 

of  the  hypothesis 

*2  = 

0  i 

r.  (1.5) 

with  normal  e  and  c 

known , 

generated  bv  select- 

ing 

12 

randomly 

from  the 

sphere  of  radius  po. 

The  significance  levi 

the 

test 

is  a  = 

.10.  The 

results  for  each  case 

are  based  on  12500 

simulations. 


4.3.  Power  Study  2 

2 

In  this  study  we  investigated  the  power  of  the  LR  test,  again  with  c  "known", 

under  the  assumption  that  the  interactions  are  drawn  independently  from  a  normal 

2  2  2  2  2  2 
distribution  with  mean  0  and  variance  ct  ,  where  o,  =  p  c'/k_  i.e.  5(21:3,,)  =00. 

b  b  2  ~2~2 

The  designs  considered  were  the  tr<L)-optimal  fractional  factorials  of  Section  3;  *or 
these  designs  the  test  statistic  w  and  its  mean  and  variance  are  easilv  calculated  from 
the  lengths  of  the  strings  of  confounded  two-factor  interactions.  (Se^  Appendix  H  for 
deta i Is. ' 


The  distribution  of  w  was  approximated  by  that  of  w*  =  g  v  ,  w'-ere  ?1  and  3, 

1  ?2 

were  chosen  so  that  the  mean  and  variance  of  w'  matched  those  of  w.  We  determined  for 
each  design  the  value  of  p  for  which  the  power  is  .90  for  tests  conducted  at  the 
a  =  .10  level  of  significance.  (Actually,  we  are  discussing  expected  power  here,  where 
the  expectation  is  taken  over  the  assumed  normal  distribution  of  the  interactions.'  T^ese 
"minimum  detectable"  values  of  p  were  calculated  for  (i)  n  >  2k,  3  <  k  <  1C,  n  <  128, 
for  the  designs  in  Table  12.15  of  Box,  Hunter,  and  Hunter  (1978),  which  a- e  minimum 
aberration  designs  of  resolution  >4,  and  for  (ii)  n  <  2k,  3  <  k  <  10,  n  >  4,  for  tve 
minimum  aberration  resolution  II  foldovers  presented  m  Section  3.2.  Some  results  are 
shown  in  Table  4.2,  for  k  =  5  and  k  =  10,  as  well  as  the  limiting  cases  as  k  *  Ir. 
the  case  k  =  5,  n  =  8,  for  example,  the  interactions  need  to  be  big  enough  to  cause  a 
"typical"  disturbance  of  magnitude  2. Old  at  a  randomly  selected  corner  of  the  5-cube  in 
order  to  be  detected  with  probability  .90  by  the  LR  test  with  a  =  .10. 

* 

To  obtain  an  approximation  to  the  minimum  detectable  value  of  p,  (0  (a,P,k,n),  say), 
for  specified  significance  level  a  and  power  P,  once  can  use  the  equation  for  the 
limiting  value  as  k  ■»  °°,  which  can  be  shown  to  be 


p* (a,P,“,n)  =  l(x^;X;P  "  '1>/2^/2 


where  a  =  n/2-1  and  a  is  the  upper  100ci%  percentaoe  point  of  the  x~ 

* 

distribution.  (See  Appendix  E.)  Since  0  does  not  change  much  with  k ,  (4.3)  can  he 

* 

used  to  approximate  p  (a,P,k,n). 

Although  the  results  of  Tables  4.1  and  4.2  do  not  represent  a  very  comprehensive  st-: 
of  power,  they  do  serve  to  indicate  roughly  what  the  user  can  expect  from  tl'e  desicns  5' 
Sections  2  and  3  with  respect  to  their  ability  to  detect  the  presence  of  interact io-s .  1 


the  next  section,  we  shall  consider  other  desian  ob-ectives. 
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k  ! 
1 

4 

8 

16 
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Table  4.2 

.  Power 

study  2: 

Minimum 

detectable  values  of 

9  for 

the  LR 

test  of 

2 

the  hypothesis  & 

=  0  at 

the  a  =  .10 

significance 

level,  o 

known 

,  using 

tr (L)-optimal  frac 

tional  factorials 

described  in  Section  3.  Here  a  value  of  p  is  "detectable"  if  the  expected 
power  of  the  test  is  at  least  .90  when  the  elements  3^  are  drawn 


independently  from  a  normal  distribution  with  mean  0  and  variance 

.e. 


2  2  2 
ofa  =  p  a  /k2« 


E(3J32)  =  p2o2. 


5.  Modification  of  tr(L)-Optimal  Designs  to  Suit  Additional  Objectives 

Seldom  is  an  experiment  planned  in  practice  with  just  a  smale  purpose  m  mind,  so  we 
shall  now  examine  the  designs  of  Sections  2  and  3  with  respect  to  some  other  objectives  and 
suggest  some  design  modifications. 
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5.1.  Fitting  the  First-Order  Model 

when  n  >  2k,  the  tr(L)-optimal  designs  are  orthogonal  (or  nearly  so)  for  the  first- 
order  model:  -(^)  =  so  they  need  no  modification  to  estimate  efficiently, 

when  n  <  2k,  however,  the  tr(L )-optimal  foldovers  presented  in  this  paper  do  not  oernir 
estir  n  of  S.]  in  the  first-order  model.  For  these  situations,  we  tried  several 

appro  s  to  the  construction  of  "compromise  designs"  which  would  have  relatively  hsa1' 

values  of  tr(L)  and  would  also  orovide  estimabilitv  of  5.  (Morris  and  vitc'-^ll 

v  “  *  —1 

(1977)).  Our  most  successful  procedure  was  the  follovma.  The  sire  of  th»  rinal  de«=ia~, 
n,  is  specified  as  well  as  the  size  of  a  smaller  foldovcr  de-:an,  2r. .  A 
tr(D -optimal  foldover  design  in  2n  runs  is  t^en  obtained  ar.1  auamen-e'5 
n  -  2n  runs  whi^h  maximize  the  determinant  of  X^X  for  t*'o  c\ -'a’ 


5 

I 

1  ^ 


*  1  *»- 


Compromise  designs  were  constructed  m  this  way  for  k  =  4  through  *$,,  with 
r.  =  k+2  through  2k  - 1  and  vary  me  n.  The  augmentation  was  done  using  the  PFTY.5X 
algorithm  (Mitchell  ( I?7'!.’. ' .  T " c  desicr.s  which  have  the  minimum  number  o-'  augmenting  runs 
for  fixed  n  are  presented  in  Table  5.1.  For  t^ese  rir.inally  augmented 
tr(L)-optinai  designs,  the  augmentation  does  net  affect  tr(L);  in  fact,  the  "extra"  runs 
(those  not  marked  with  an  aste-is'-  ir  the  table;  are  not  used  at  all  ir>  the  lr  test  of 
the  hypothesis  that  3  =  2.  ~*-e  user  of  one  of  the  compromise  designs  in  Table  5.1  can 
therefore  refer  to  the  results  of  Section  4,  particularly  Table  4.1,  for  an  indication  of 
the  ability  of  the  desion  to  detect  the  presence  of  interactions. 
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Table  5.1.  Comnro—sse  lessons  *■'  nrs  runted  hy  aus***-.”' tines  *  r  *  *  )*Apt:n,il  dessnns  to  r*ernit 
est inability  n!  -'am  »  notatio"  in  sse5  t-  r^fer  *n  tv'e*  level  "-1".  “ach 

design  also  cental's  **  *  -sever  of  runs  >5  wit-  *. 
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Before  going  on  to  the  consideration  of  other  design  objectives,  we  should  remark  that 
unaugmented  tr(L)-optimal  designs  with  n  <  ?k  can  be  of  practical  use,  even  though  they 
do  not  permit  estimation  of  6^  This  is  particularly  true  when  one  is  dealing  with  a 
large  number  of  factors  and  the  number  of  runs  is  quite  limited.  Common  oractice  is  to  use 
a  first-order  design  in  hopes  that  the  main  effects  will  override  the  interactions,  and 
then  perhaps  to  follow  up  with  further  runs  to  seek  out  interactions  among  the  large  main 
effects,  when  substantial  interactions  are  present,  however,  inferences  drawn  from  a  main 
effects  design,  and  subsequent  experimental  plans  based  on  those  inferences,  may  be 
misguided.  What  we  are  suggesting  here  is  that  in  some  cases  it  may  be  worth  spending  a 
few  early  runs  (4  to  8,  say)  in  order  to  find  out,  in  a  general  way,  how  important  the 
interactions  are. 


S.2.  Identifying  the  Second-Order  Interactions 

Once  the  presence  of  interactions  has  been  established,  additional  runs  can  be  made  to 
identify  the  larger  ones.  If  one  can  afford  it,  one  miaht  wish  to  augment  the  initial 
tr(L)-optimal  design  to  provide  estimates  of  all  the  interactions,  e.g..  Example  4  of 
Mitchell  (1974a).  In  many  situations,  it  will  be  more  efficient  to  concentrate  on  a  subset 
of  interactions,  as  in  the  following  example,  condensed  from  Morris  and  Mitchell  (1977). 
Example  5.1.  This  is  a  hypothetical  example  with  7  factors,  in  which  data  were 

simulated  according  to  the  equation  y  =  64  -  7xi  -  19x3  -  18x1X3  +  e,  where 

2  7-4 

e  ~  N(0,a  ),  and  0  =  5.5.  The  initial  design  was  a  tr (L)-optimal  2  design, 

constructed  as  indicated  in  Section  3.  The  design  points,  data,  and  estimates  of  strings 

2 

of  confounded  effects  are  shown  in  Table  5.1a.  Assuming  o  is  known,  the  LR  test 

statistic  for  the  hypothesis  of  no  interactions  is  20R8. 86/30. 25  =  68.99,  which  is  hiahlv 

2 

significant  when  referred  to  the  X3  distribution.  Clearly,  th-'  most  likely  candidates 

for  larae  interactions  are  those  in  the  strina  8,,  *  3,.  *■  3_,  ♦  8_.  ♦  3.,  +  3,,.  ffince 

13  !•»  23  24  S7  (17 

2 

the  estimate  of  the  three  strinqs  of  interactions  are  independent,  the  X3  statistic  could 
have  been  partitioned  to  qi’-n  a  separate  lack  of  fit  test  for  each  strinn.  In  the  present 


!  I 


case,  this  would  lead  to  rejection  of  the  null  hypothesis  only  for  3^,+. . . +3,?. )  Eight 
additional  runs  were  needed  to  estimate  the  main  effects  and  the  six  susnected 


interactions.  These  runs  were  chosen  using  DETMAX  to  maximize  the  determinant  of  X'X  for 


all  16  runs,  where  the  model  is  now 


E(y)  -  S0  +  J  Xi6i  +  V3613  +  X1X4S14  +  X2X3623  *  X2X4S24 


+  X5X7B57  +  X6X7B67  * 


8+6  +6  +8  *  62 1 92 

0  12  34  56 


6,  +  S2  =  -5.58 


3  +  3  =  -19.96 

3  4 


6,  +  6,  =  5.09 

3  O 


3?  =  1.46 


3  +3  +3  +3  +3  +3  =-n.54 

17  °27  °35  36  45  46 

6  +3  +3  +3  +3  *3  =3.79 

15  16  25  26  37  47 


3  +3  +3  +3  +3  *  3  =  —16*11 

13  14  23  24  57  67 


Table  5. ’a.  Oata  and  estimates  of  effects  cor  t *t  ?, 
Examnle  5.1. 
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Tho  data  for  tho  fl  new  runa  and  the  aatimataa  of  tha  parameters  In  tha  nsw  modal  ara  giver 
in  Tabla  5.1b.  Tim  paramatar  aatimataa  ara  not  very  j>r  sc  Iso.  sines  we  Hava  added  tha 
fewest  runa  poaaibla  to  achiava  aatimabllity.  Evsn  ao,  In  runa  we  hava  found  that 
intaractiona  ara  not  negligible  and  hava  diacovarad  tha  important  ona.  Thla  uaa  of 
tr(j^)-optimal  designs  to  idantify  a  faw  strings  of  potantial  intaractiona,  which  ara  than 
broken  down  by  furthar  runa,  ia  very  aimilar  in  apirlt  to  Watson's  (19(1)  approach  to  tha 
problam  of  screening  for  main  affacta. 
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Table  5.1b.  Additional  data  and  estimates  of  effects  for  the 
model  (5.1)  in  Example  5.1. 

Had  the  initial  R-run  design  in  this  example  given  no  Indication  of  the  presence  of 
Interactions,  wo  could  have  chosen  our  Additional  eight  runs  to  give  a  good  estimate  o'  the 
parameters  in  tho  first-order  model,  as  described  in  Section  5.1.  The  result! no  in-run 
design  would  then  turn  out  to  bn  the  2^  dasign  with  nenerntnrs  1234,  1256,  and  )3n" 
(Morris  ami  Mitchell,  1977),  The  Interactions  should  he  examined  again  at  this  nolnt, 


' •  ^ •  Patenting  the  Presence  of  Other  Von-Mnear  rffectn 

If  some  of  the  factor*  are  continuous,  then  there  may  well  ho  departures  from  th* 

*  lrat-order  model  that  do  not  involve  interaction*!  Thn  two-level  designs  considered  in 
this  paper  will  not  be  good  for  detecting  such  effect*! 

Th*  mo*t  ohviouo  augmentation  in  this  cane  would  involve  adding  one  or  more  "conter 
point"  run*  in  which  the  quantitative  factor*  are  all  net  to  a  central  value!  Takinq  a 
formal  deoign  optimalitv  approach,  Jonas  and  Mitchnll  (1075,  Section  4,3,1)  applied  their 
A, -optimal tty  criterion  (from  which  our  tr(L)-optimality  wae  derived)  to  the  two-factor 
quadratic  response  surface  model,  and  indeed  found  in  all  cases  (n  *  4  -  10)  that  the 
optimal  design*  for  a  rectangular  region  of  interest  were  supported  entirely  on  the  corners 
and  at  the  center  of  the  region, 

when  n  <  2k,  the  use  of  a  center  point  also  aids  in  identifying  the  interactions  (by 

separating  a  string  of  interaction*  from  6q),  but  does  not  seem  very  efficient  in  terms 

of  the  tr(L)  criterion.  It  can  bo  shown  that  the  increase  In  tr(L)  resulting  from  the 

sddition  of  a  row  of  k  0's  to  a  foldover  (n,k)-de*i»n  is  (nk  -  old  tr(L))/(n+l ) ,  which 

2  ** 

ia  relatively  small,  especially  whan  compared  with  the  gain  that  can  be  made  by  adding  a 
new  foldover  pair, 

W#  have  not  considered  the  question  of  how  many  center  points  to  add,  nor  the  more 
interesting  question  of  how  to  take  center  points  when  not  all  the  variables  are 
quantitative. 

2  _ 

5.4.  Estimation  of  o 

In  our  discussion  of  the  LR  test  for  the  presence  of  interactions,  and  in  Example 
2 

5.1,  we  assumed  that  a  was  "known".  We  shall  now  consider  designs  with  the  dual  purpose 

2 

of  maximising  tr(L)  and  obtaining  an  estimate  of  a  through  replication  of  some  runs. 
Consider  the  construction  of  a  tr(T,)-optimal  foldover  design  under  the  restriction 

A* 

that  n  rows  of  the  n  *  V  hnlf-dosion  D  are  replicated  once,  where  n  <  V  «•  n  . 
e  ~  p 

When  V  3  0,1,  or  3  (nod  4),  thin  ia  achieved  hy  replicating  any  n  foldover  pairs  of  a 

P 
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tr (L)-optimal  (2n-2n^,k)-de8ign.  (Sea  Appendix  F.)  If  k  2  2(mod  4),  we  can  use  the 
following  procedure.  Partition  a  column  orthogonal  (k-2)  x  (n-n^)  matrix  Dn  aa 
g0  *  [£.g] ,  where  A  has  columns  and  B  has  n  -2n^  columns. 

<v 

Now  let  the  k  x  n  matrix  D„  have  the  form 


where  |2ala„  +  blb,|  <  1.  (Notei  If  n-n  *  k  or  n-n  ■  k-1 ,  choose  D„  Instead  to 
~1~2  ~1~2  e  e  ~0 

be  a  column-orthogonal  (k+2)  x  (n-n^)  matrix.  g1  is  then  formed  by  removing  from 
D.  two  rows  (a1,  a',  bl)  and  (a'  a'  bi)  that  satisfy  the  above  property.)  If  we  now 
transpose  D  and  fold  it  over,  the  result  will  be  a  2n  x  k  foldover  design  which  is 

tr(L)-optimal  subject  to  the  restriction  that  ne  foldover  pairs  are  replicated  once.  A 
short  proof  is  given  in  Appendix  F. 

When  n  >  k  +  n^,  we  have  not  found  a  general  procedure  for  constructing 
tr(L) -optimal  designs  subject  to  replication  of  n^  foldover  pairs.  However,  the  rules 
of  Section  2.3  are  not  very  restrictive,  and  it  is  often~poBSible  to  construct  designs  that 
satisfy  these  rules  and  also  replicate  some  runs.  For  example,  the  6x4  matrix  with 
rows  (1,-1, -1,1),  (1,1, -1,-1),  ( 1 ,-1 , 1 , -1 ) * ,  (1,1, 1,1)*,  where  the  asterisks  indicate 
replication,  yields  a  tr (L)-optimal  design  (Case  3  of  Section  2.3)  when  folded  over. 

6.  Example!  Sensitivity  Analysis  for  a  Computer  Code 

The  Oak  Ridge  Inverse  Code  (ORINC),  ( ot fe  and  Hedrick  (1977)),  is  used  to  calculate 
temperature  and  heat  flux  at  the  surface  of  the  electric  heater  rods  in  a  simulated  nuclear 
reactor,  given  the  heat  generation  rate,  the  geometry,  thermophysical  parameters,  and  the 
thermocouple  temperature  at  an  axial  position  of  one  of  the  rods. 
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To  determine  the  sensitivity  of  ORINC's  results  to  variations  in  key  parameters,  a 

12-7 

computational  experiment  was  conducted.  The  experimental  design  was  a  32-run  2 
fractional  factorial  design  in  the  12  factors  (parameters):  (1)  MgO  radius,  (2)  inconel 
thickness,  (3)  Bn  thickness,  (4)  inner  sheath  thickness,  (5)  outer  sheath  thickness,  <6) 
gap  size,  (7)  thermocouple  temperature,  (8)  power  peaking  factor,  (9)  voltage,  (10) 
amperage,  (11)  MgO  conductivity,  and  (12)  Bn  conductivity.  The  two  levels  of  each 
parameter  were  at  one  standard  deviation  above  and  below  the  nominal  value  of  that 
parameter,  where  the  standard  deviations  were  based  on  given  "uncertainty  distributions". 
Sensitivities  were  defined  in  terms  of  main  effects,  calculated  in  the  usual  way.  Strings 
of  two-factor  interactions  were  also  estimated  and  found  to  be  negligible.  Assessments  of 
importance  of  effects  were  based  on  relative  magnitude)  there  is  no  statistical  error 
involved. 

In  the  following,  we  shall  use  some  of  the  data  from  this  computer  experiment  to 
demonstrate  how  a  small  preliminary  tr(L) -optimal  design  might  have  been  used  to  provide 

an  early  assessment  of  the  importance  of  interactions.  The  chosen  8-run  tr (L)-optimal 
1  ?-9 

2  design,  augmented  by  the  center  point,  is  shown  in  Table  6.1,  with  the  heat  flux 

results  of  the  ORINC  runs  and  the  calculated  effects.  (Table  6.1  shows  only  the  heat 
flux  y(t)  at  time  0;  however,  each  ORINC  run  gives  the  values  of  heat  flux  as  a  function 
of  time,  and  the  effects  may  be  plotted  in  this  way.) 
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Table  6.1.  A  tr(L) -optimal  2  design  plus  center  point,  with  data  from  Example 

6.1.  The  numbers  in  the  factor  aliasinq  relations  stand  for  subscripts  on  the 
coefficients  (B's)  in  the  model. 


On  the  basis  of  these  results,  we  would  tentatively  infer  that  interactions  are 
negligible,  althouah  we  still  need  to  be  aware  of  possible  "cancellations"  witvm 
interaction  strings.  We  can  then  proceed  with  a  first-order  demon  wit*'  some  confi  JP”r» 
that  the  larger  main  effects  will  correctly  identify  the  parameters  to  wMch  the  Ci'-’IV* 
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2  +  (11 

+  (12) 

-  7.4 

\ 

a2 

1  +  3  + 

4 

-73.4 

»■ 

A3 

6  +  7  + 

(10) 

7.1 

< 

A4 

5  +  8  + 

9 

3.6 

j  ’ 

A1A2  +  A3A4 

12  +  23 

+  24  +  1(11)+. 

..+500) 

+ 

800)  + 

9(10)  0.4 

i 

A1A3  +  A2A4 

26  +  27 

+  2(10)  +  6(11)+. ..+45 

+ 

48  +  49 

0.4 

l 

A1A4  +  A2A3 

25  +  28 

+  29  +  5(11)+. 

•  *+46  ♦* 

57 

+  4(10) 

-  0.1 

i 

2(11)  + 

2(12)  +  (11)02)  +  13+ 

• 

+58  +  59 

+  89  1.4** 

1  !  1 
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results  are  most  sensitive.  In  tl-e  present  case,  1?.  additional  runs,  combined  with  the 


V>-8 

four  marked  with  an  asterisk  in  Table  6.1,  yield  a  2  ^  design  with  generators  128,  136, 


147,  238,  249,  34(10),  123(11',  and  234(12).  The  main  effects  are  given  in  Table  6.2. 


(For  simplicity  we  calculated  these  effects  using  only  the  16  runs  of  the  2  ”  design.) 
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Table  6.2.  Main  effects  from  .  design  in  Exam.;.!. 


Had  this  investigation  involved  a  very  large  number  of  factors,  augmentation  to 


estimate  all  main  effects  might  not  he  feasible.  A  reasonable  approach  in  this  case  might 


be  to  estimate  individual  effects  only  within  main  effect  strings  that  appear  to  be  large 


in  the  initial  design  (Watson  (1961)).  For  these  factor  screening  applications,  one  should 


attempt  to  assign  "+"  and  to  eac*  factor  m  such  a  way  that  a  “+"  corresponds  to 


an  anticipated  increase  in  response.  If  one's  guesses  of  the  direction  of  effects  are 


correct,  this  will  elimnate  the  possibility  of  "cancellations”  within  strings  of  main 


effects. 


7.  Summary  and  Conclusions. 


We  have  giver,  here  the  results  of  the  application  of  a  design  ootimality  criterion 


(maximization  of  tr(L)  where  L  =  X^X^  -  X^X 1 (X  ^X  .j )  X^X0)  to  the  nroblero  of  designing 


two-level  n-rur.  experiments  to  detect  the  oresence  of  two-factor  interactions  (E^)  among 


''-factors  m  the  rodel  E.’v)  =  X  S  ■*  X®.  ,  where  consists  of  a  constant  term  f. 

'  —1—1  —2—;  —1  o 


and  main  effects. 


WV  a5j-i  ftVAwI  Sine, 


i 


ifsggjsgg^g 


^.-^V^--.'-.-- -  '  ... 


~;':r*"-  -.-;l;.^'r:l7i  /. .  j 


When  n  is  a  multiple  of  8,  the  tr(L)-optimal  designs  are  orthogonal  arrays  of 


strength  3  (e.g..  Resolution  IV  fractional  factorials),  if  such  an  array  exists  (Section 


2.1).  In  other  cases,  it  appears  that  we  can  restrict  attention  to  the  class  of  foldover 


designs  (Section  2.2).  A  simple  set  of  rules  can  be  used  to  construct 


tr(L)-optimal  foldovers  (Section  2.3)  for  nearly  all  n  and  k  of  practical  interest. 


Within  the  class  of  regular  fractional  factorial  designs,  the  tr(L)-optimal  designs 


are  the  resolution  IV  designs  if  n  >  2k.  If  n  <  2k,  the  optimal  fractional  factorials 


are  foldovers  with  the  fewest  words  of  length  two  in  the  defining  relation  (Section  3.1). 


These  can  be  easily  constructed  through  the  use  of  "group-factors”  (Section  3.2).  A 


comparison  of  tr(L)-optimal  fractional  factorials  with  the  tr(L)-optimal  foldovers, 


when  n  is  a  power  of  two,  indicates  that  the  former  are  either  equally  good  or  nearly  as 


good  as  the  latter  with  respect  to  tr(L)  (Section  3.3).  To  choose  among  the  optimal 


fractional  factorial  designs,  we  recommend  the  Fries-Hunter  minimum  aberration  criterion. 


The  results  of  two  different  studies  of  power  (Section  4)  give  a  rough  indication  of 


the  ability  of  the  tr (L)-optimal  designs  to  detect  the  presence  of  interactions  when  a 


2  2 
likelihood-ratio  (x  )  test  of  the  hypothesis  8  =  0  is  used,  with  o  "known". 


Designs  presented  in  this  paper  have  some  weaknesses  with  respect  to  other  design 


objectives.  These  can  be  overcome  through  augmentation  of  various  kinds.  To  achieve 


estimability  of  when  k  +  2  <  n  <  2k-1 ,  we  present  some  "compromise"  designs  which 


have  a  tr(L)-optimal  design  as  a  nucleus  (Section  5.1).  Augmentation  to  identify 


important  individual  interactions  is  illustrated  by  means  of  an  example  (Section  5.2).  If 


the  factors  are  continuous,  the  addition  of  a  center  point  is  an  aid  to  detection  of  the 


presence  of  other  non-linear  effects,  particularly  ouadratic  terms  (Section  5.3). 


Estimation  of  c  can  be  achieved  by  replicating  some  foldover  pairs,  and  some  simple 


rules  are  given  in  Section  5.4  for  constructing  tr(L) -optimal  foldovers  subject  to  the 


specified  replication  reouirements. 


When  k  is  large  and  the  number  of  runs  in  limited,  some  of  the  desiqns  nresented 
here  are  effective  as  preliminary  designs  for  detecting  in  relatively  few  runs  whether  it 
is  reasonable  to  proceed  with  an  experimental  strategy  based  on  a  first-order  model.  An 
example  of  this  type  of  application,  to  a  sensitivity  analysis  of  a  computer  code,  is  aiven 
in  Section  6. 
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Appendix  A:  Maximization  of  Under  a  Design  Randomization  Scheme 

Consider  an  (n,k)-design  0,  with  corresponding  matrices  X^  X^,  and  L  as  defined 
in  (1.5)  and  (1.7).  We  further  define  H  =  X 1  (X*X  1 ) ;  thus  L  =  For  anv 

x,  tlx  is  the  proiection  of  x  onto  the  space  spanned  by  the  columns  of  X  and 
x'(I-H)x  is  the  distance  from  x  to  that  space. 

we  propose  to  select  the  design  DR  for  the  experiment  by  the  following  twe-staco 
randomization  scheme  R  =  R^P.,: 

R^ :  Randomly  relabel  the  factors  in  D  so  that  each  one  of  the  k!  possible 
labelings  has  the  same  probability  of  realization. 

Rji  with  probability  P.5,  reverse  the  levels  of  factor  i  in  r,  inder>en'*eo*-lv  -o; 
e  ach  i  —  1,2,... ,k. 


-ns- 


mu' 


The  matrices  X1R/X2R*HR<  and  LR  are  obtained  from  DR  in  the  same  way  that  X.,)C2.g, 
and  L  are  obtained  from  D. 


The  expectation  of  A  =  S'L_8„  under  the  randomization  R  is 
n  ~2~R~2 


W  =  Er1Er2IR1  (^2> 


(A.1) 


=  E„  (B'X*  (I-H)X  8,)  . 

R1  R2  K1  ~2~2R - ~2R~2 


(The  substitution  of  H  for  HR  is  justified  by  the  fact  that  the  columns  of  X1R  span 
the  same  space  as  the  columns  of  so  the  distance  from  any  vector  to  that  space  is 

invariant  under  the  randomization. 


We  can  express  £2r  as 


*2R  = 


(A. 2) 


where  P  is  a  permutation  matrix  which  permutes  the  columns  of  X.,  accordina  to 


and  g  is  a  diagonal  matrix  with  diagonal  elements  +1  or  -1  reflecting  the  effect 


of  R-  on  the  columns  of  X'  P„  .  A  specific  o.  jt.  al  element  of  CV  has  the  form 
*  *v2"'R- 


where  q^  and  cjj  aie  (independently)  ,  ,>r  -1  with  probability  0.5.  Gi\ 

^Ir/^rW^’  =  % ,  > 
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and  typical 


A  typical  diagonal  element 
off-diagonal  alamsnta  arc 

\lR,(,1iVveij‘5lk)  "  0 

( A. 1 )  to  yield 


v,'V;l!aV  *’ 

■ 0  11  * 1  i  k  ' 11 

(1  f  j  y  k).  Henco  (A. 3)  can  he  simplified 


and 

and  substituted  into 


E_(X„>  "  E„  tr  [P '  LP  B]  -  tr  (I.E  (!’  BP'  )) 
1  1  1  1  *1  K1 


(A. 4) 


2 

where  n  la  a  diagonal  matrix  with  diagonal  elements  6,  .»  Since  P  is  a  permutation 
~  i  j  ~R  y 


matrix,  P  BJP'  in  a  diagonal  matrix  obtained  by  permuting  the  diagonal  elements  of  B. 

1  1 

Over  all  such  permutations  generated  by  the  randomization  procedure  R^,  the  expectation 

E_  (P_  BPi  )  is  just  b  I  where  b  **  (]  £  Substituting  into  (A. 4),  we  finally 

R1  R,  R,  !<j  13  2 

obtain 


SR(V  "  *  tr(~)  *  (A. 5) 

This  result  implies  that  E  ( X  1  is  maximized  by  choosing  D  to  maximize  tr(L), 
regardless  of  the  value  of  £2 .  (The  subsequent  data  analysis  should,  of  course,  be  made 
conditional  on  the  design  that  was  actually  selectod.) 


2 

Appendix  Bi  Minimization  of  Tr(P'D)  ,  Where  |d^|  "  ’• 

The  following  results  justify  the  Gray-Cheng  rules  for  constructing  the  n  x  y 
matrix  t>  in  Section  2.3.  For  simplicity  of  notation,  we  use  D  and  n  here  instead  of 
0  and  n. 

N 

I.et  D  he  an  n  *  h  matrix  whose  elements  d^  must  he  +1  or  -1,  We  want  to 
2 

minimize  tr(D'D)  ,  which  is  the  sum  of  saunter  of  the  elements  of  n'o.  Since  the 
diagonal  elements  of  h'n  are  eeual  to  n  for  all  D,  we  ran  restrict  attention  to  the 


of f-di snonal  nlenents. 


We  shall  assume  here  that  k  <  n.  The  results  for  k  >  n  follow  directly  from  the 
fact  that  tr(D'D)2  -  tr(DD')2. 


Case  1 :  n  =  0,  mod  4. 

If  D  is  column-orthogonal,  it  is  optimal,  since  the  off-diaqonal  elements  achieve 

2  2 

their  minimum  in  absolute  value,  0.  We  then  have  tr(D'D)  =  kn  .  This  construction  can 
be  used  whenever  a  Hadamard  matrix  of  order  n  exists.  (As  of  1977,  the  smallest  order 
for  which  a  Hadamard  matrix  had  not  been  constructed  was  268,  according  to  Hedayat  and 
Wallis  (1978).  We  are  not  aware  of  any  changes  in  this  list  since  then.) 

Case  2:  n  =  1 ,  mod  4 . 

Since  the  off-diagonal  elements  cannot  be  0  in  this  case,  it  is  evident  that  if  all 

the  off-diagonal  elements  of  D'D  are  +1  or  -1,  then  D  is  optimal.  We  can  construct 

such  a  D  by  augmenting  an  (n-1)  x  k  column-orthogonal  matrix  with  any  row  of  +  1's 

2  2  2 

and  -I's.  We  then  have  tr(D'D)  =  kn  +  k(k-1)  =  k(n  +  k-1).  The  only  subcases  in 
which  this  construction  cannot  be  used  (assuming  a  Hadamard  matrix  of  order  (n-1)  exists) 
are  those  in  which  k  =  n.  Solutions  for  n  =  5,  13,  and  25  are  given  by  Raghavarao  (1959); 
we  are  not  aware  of  solutions  for  other  cases  with  k  =  n. 

Case  3:  n  H  2,  mod  4. 

By  Ehlich's  (1964)  Lemma  3.4,  the  maximum  possible  number  of  zeros  in  D'D  is  k2/2 
if  k  is  even  and  (k2-1)/2  if  k  is  odd.  Suppose  0  is  formed  by  augmenting  an 
(n-2)  x  )<  column-orthogonal  matrix  with  two  rows  of  +1's  and  -I's,  chosen  so  that  their 
inner  product  is  D  if  k  is  even  and  +  1  or  -1  if  k  is  odd.  Then  D'D  will 
contain  the  maximum  number  of  zeros  possible,  and  all  the  non-zero  off-diaaonal  elenen-  s  of 
D’D  will  attain  their  lower  bound  in  absolute  value,  2;  hence  D  is  optimal. 

The  construction  above  suffices  when  k  <  n-2.  If  k  =  n  or  k  =  n-1,  we  can  resort 


to  a  different  method.  By  a  similar  argument  to  the  one  above,  it  can  be  shown  that  the 
removal  of  two  rows  from  an  ( n»2 )  r  k  column-orthogonal  matrix  A,  again  chosen  to  have 


-31- 


inner  product  with  absolute  value  0  or  1,  yields  an  optimal  D.  The  only  question  is 
whether  two  such  rows  can  be  found  in  A.  We  first  treat  the  case  k  =  n,  and  assume 
there  is  no  orthogonal  pair  of  rows  in  A.  Then  the  inner  oroduct  of  any  two  rows  of  A 
has  absolute  value  at  least  2,  so 


tr(AA’)2  >  (n+2)n2  +  4(n+2)(n+l) 


where  we  use  the  fact  that  the  left  hand  side  is  equal  to  the  sum  of  squares  of  the 
elements  of  AA’ .  But 


tr(AA')2  =  tr{A'A)2  =  n(n+2)2 


since  A  is  column-orthogonal,  and  it  is  easily  shown  that  (B.2)  and  (B.D  are 

incompatible.  A  must  therefore  have  at  least  one  pair  of  orthogonal  rows-  An  analogous 

argument  can  be  used  to  prove  the  same  proposition  for  the  case  k  =  n-1. 

2 

The  optimum  values  of  tr(D'D)  for  Case  3  can  easily  be  shown  to  be 

k(n2  +  2(k-2)j  when  k  is  even  and  kn2  +  2(k-1)2  when  k  is  odd. 

Case  4:  n  =  3,  nod  4. 

If  we  remove  any  row  from  an  (n+1)  x  k  column-orthogonal  matrix,  the  resulting  matrix 
D  will  be  optimal,  by  the  rime  argument  used  for  Case  2  above.  As  in  Case  2,  the  optiou- 
tr(D'D)2  is  k(n2  +  k-1). 


Remark :  The  above  arguments  establish  lower  bounds  for  tr(D'O)'  even  for  the 
(sparse)  pairs  (n,k)  for  which  the  suggested  construction  is  not  possible. 
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Appendix  C  -  On  Tr(L) -Optimality  in  the  Class  of  Regular  Fractional  Factorials 


V — n 

Theorem  Cl.  No  2  p  fractional  factorial  design  having  words  of  length  1  or  3 


in  its  defining  relation  can  be  tr(L)-optimal  among  regular  fractional  factorials. 

The  proof  is  by  construction  of  the  superior  2*"?  design  F2(F.j,i)  where  r2  is 
obtained  from  a  given  2^'P  design  F1  by  folding  over,  for  suitably  chosen  i,  the  haif 


of  F1  in  which  x^^  =  1.  We  shall  use  the  notation  [i],  lij],  (iji]  to  refer  to  first-. 


second-,  and  third-order  design  moments,  respectively. 


We  note  that  tr(L)  is  the  sum  over  all  pairs  (i  <  j)  of  the  squared  distance  from 


x„  (the  column  of  X2  corresponding  to  8^)  to  the  space  spanned  by  the  columns  of 


X^.  In  a  regular  fractional  factorial  design  this  squared  distance  is  either  n  (if 


x^  is  orthogonal  to  X^  or  0,  so  tr(L)  is  just  n  times  the  number  of  columns  in 
X2  that  are  orthogonal  to  X^ . 

Given  a  2*-p  design  F1  with  words  of  length  1  or  3  in  its  defining  relation, 


the  construction  of  F2(F1(i)  with  larger  tr(L)  is  based  on  the  following  lemmas. 


Lemma  Cl.  For  any  i  such  that  ti]  =  0,  any  column  of  £2  that  is  orthoaonal  to 


X1  in  F1  is  also  orthogonal  to  X1  in  F2(F1,i). 

Proof  of  Lemma  Cl.  Suppose  X^  =  0  in  F^  This  implies  in  particular  'i'  = 


lij]  =  0  in  F.j,  so  x.  anu  x^  form  a  factorial  design  (possibly  replicated',  a 


property  we  shall  hereafter  refer  to  as  Property  A.  It  is  easily  seen  that  x.  and  x^ 


also  have  this  property  in  F2(F1,i).  Because  F2(F1,i)  is  a  foldover,  all  its  odd-order 


design  moments  are  0, 


so  x!  .  X  =  0  in  F,(F.,i)  iff  (ij)  =  0 

~ij  ~1  ~  *  1 


■>,(?,, i>.  we  have 


already  established  that  lij]  =0,  so  the  lemma  is  proved  for  columns  of  the  form, 


x...  We  still  need  to  consider  columns  of  form  x  . .( j^l , ) ,  with  x\  X„  =  0  in 
F1.  We  then  have  Iji]  =  0  and  [iji]  =  0,  and  we  recall  that  i  was  chose-  sue-1-  -‘-a- 


li]  =  0.  Thus  x^  and  x^j,  have  Property  A  in  F1 ,  and  also  in  F-^Fj.il,  w'"icw 


as  above  to  the  result  that  xl^  X^  =  0  in 


•4 

?  m 


Remark  on  Lemma  Cl.  Tho  lemma  shows  that  for  any  glvun  fractional  factorial 

design,  there  exists  a  fractional  factorial  fol dover  design  with  tr(L)  at  least  as 

great  an  that  of  the  given  design.  The  lemmas  which  follow  establish  the 
tr(L)-  superiority  of  the  foldover  when  the  given  design  has  momenta  of  order  1  or  3. 

Lemma  C2 .  If  k-p  >  2  and  there  exists  1  nuch  that  !j)  ¥  0  in  K,,  then  there 
oxiatn  i  such  that  KjiK^l)  has  greater  tr(L)  than  does  Fj. 

Proof  of  I.emma  C3 .  t.et  x^  and  x^  he  two  columna  having  Property  ft  in  F,,.  (Two 
■ueh  columns  always  exist  when  k-p  >  2.)  Since  [Jl  ¥  0  tn  F^,  x^  ¥  0  in  F^. 

But  [jt]  -  0  in  F1  and  also  in  F  0  ( F , ,  i  > ,  which  implies  that  x^  X 1  *  0  in 
F^iF^l).  The  set  of  columns  in  X  that  are  orthogonal  to  in  FjtF^/i)  therofore 

includes  x^j  as  well  as  all  tho  columna  of  that  ware  orthogonal  to  X^  in  F^  (by 

Lemma  Cl)  no  Lemma  C2  in  proved. 

Remark  on  Lemma  C2.  In  the  case  k-p  ■  1,  which  is  not  covered  by  the  lemma,  there 
are  only  ?.  runs,  and  tr(L)  is  always  0. 

Lemma  C3.  Lot  all  first-order  design  moments  in  the  2,?"p  design  F1  be  0,  and 
suppose  that  F 1  has  at.  least  one  non-zero  third-order  moment  fijk).  Then  F2 ( F 1 , 1 )  has 
greater  tr(L)  than  does  • 

Proof  of  Lemma  C3.  In  Fj,  (ijl  “  0  (otherwise  (k)  ¥  0 ) »  hence  x^  and  x^  have 
Property  A  in  F 1  and  in  F  2  ( F 1 ,  i ) .  Thus  (ij)  ■»  0  In  FjfF,,!)  so  xj^  X1  »  0  in 
Fj ( F ^ , i ) •  Recall  that  x!^  X^  f  0  in  F1  (because  (ijk)  ¥  0  there),  so  by  tho  same 
argument  used  In  the  proof  of  Lemma  C2,  we  conclude  that  there  are  more  columns  of  X^ 
orthogonal  to  X^  in  F,(Pj,i)  than  In  F^. 

Proof  of  Thoorom  Cl.  Hvory  word  of  length  1  or  3  in  tho  defining  relation 
corresponds  to  a  non-zero  first  or  third  order  design  moment.  Lemmas  C2  and  C3  imply  that 
such  designs  always  have  lower  triL)  than  some  2^'~P  fractional  factorial  foldover, 
which  has  no  words  o'  odd  length  because  It.  1  n  a  fnldover. 

Theorem  C2.  If  n  *  3k ,  a  necensary  condition  for  a  2k“p  design  to  b«> 
trlLI-orit jmal  in  the  claim  of  regular  fractional  factorials  is  that  It  be  a  foidnver 
dent  on . 
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Proof :  With  appropriate  relabeling  of  the  variables,  p  generators  of  a  2k-p 


design  can  be  chosen  so  that  they  have  the  form:  K1(k  -  p  +  1),  w'2(k  -  p  +  2) , . . .  ,v:  ( k) , 


where  each  Wj  is  a  word  composed  of  letters  (variables)  ir.  the  set  1,2,...,k-p  .  There 


are,  in  general,  n  =  candidates  for  each  (including  the  "word”  with  no 


letters),  which  we  denote  by  ,  j  =  1,2, ...,n.  If  we  denote  by  n(C^)  the  number  of 


tines  Cj  is  selected  as  one  of  the  h\ 1  s ,  then  we  see  that  the  vector  m  = 


(m(C.j) , . ..  ,si(C  ) ) *  detemines  the  resulting  2*1-?  design. 


he  first  consider  a  design  F1  with  words  of  odd  length  in  the  defining  relation,  and 


show  that  it  cannot  be  tr (L)-optinal .  If  there  are  any  words  of  length  1  or  3 


present,  the  result  follows  immediately  from  Theorem  Cl,  so  we  need  consider  only  designs 


whose  first-  and  third-order  design  moments  are  0.  For  such  designs,  tr (L)  =»  n(k,-n2) , 


where  n2  is  the  number  of  words  of  length  2  in  the  defining  relation,  so 


tr(L)-  optimality  is  equivalent  to  minimization  of  n2.  Words  of  length  2  occur  in  two 


ways:  (i)  as  generators  in  which  wv  has  length  1  and  (ii)  as  the  product  of  two 


generators  having  identical  hb.  Thus, 


n  =  T  r.  .(m.-1)/2  +  T  3i. 

2  i  3  3  jCJ,  5 


where  J,  =  { j I has  length  lj.  Since  F{  has  words  of  odd  length  (>5)  in  its 


defining  relation,  any  set  of  generators  for  F^  must  contain  at  least  one  word  of  odd 


length,  without  loss  of  generality,  we  choose  one  of  these  odd  generators  and  denote  it 


by  C  ,k  where  C  .  has  even  length  >4.  It  follows  that  m.  =  0  if  C,  has  length  one 


less  than  C  *  and  C  is  contained  in  C  ,  (i.e..  the  length  of  C^C  ,  is  15: 


otherwise,  there  would  be  a  word  of  length  3  in  the  defining  relation.  Denote  one  of 


these  j's  for  which  ra^  =  0  by  ■)' .  Now  we  find  3”  such  that  (i)  n  >  2  or  ( 1  i ) 


3"  C  J1  and  r.itt  >  1.  (Such  a  j"  must  exist:  otherwise,  n,  =  0  by  eciuation  (C-1) 


and  F1  would  he  a  resolution  IV  design  ir  n  <  2k  runs,  which  is  impossible  (Webb 


(1968),  Margolin  (1469).)  Define  a  new  2"~  design  Fj  by  addino  1  to  r>^,  (making 
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it  1)  and  subtracting  1  from  n^„.  From  (C.1),  we  see  that  this  reduces  the 


contribution  of  n^»  to  n2  but  leaves  the  contribution  of 


at  0.  Thus 


•  2 


fewer  two-letter  words  in  its  defining  realtion  than  dees  F1,  and  so  has  larger  tr'L). 

V  mm  Tj 

We  have  thus  established  that  in  order  for  a  2  •  design  with  r.  <  2  k  to  be 

tr(L)-optinal,  its  defining  relation  nust  consist  entirely  of  words  cr  even  length.  Put 
this  is  the  sane  as  requiring  it  to  be  a  foldover  design.  (For  example,  it  is  easy  to  se» 
that  if  a  design  with  no  odd  words  in  its  defining  relation  is  split  into  two  parts , 
according  to  whether  x1  =  +1  or  x1  =  -1 ,  each  part  is  the  negative  of  the  other.) 
Theorem  C2  is  therefore  proved. 

Remark:  Theoren  C2  can  be  extended  to  the  case  n  =  21c.  The  tr  (L)-  optimal 
fractional  factorial  design  in  this  case  is  the  "minimal"  or  “saturated”  resolution  IT 
design  and  nust  therefore  be  a  foldover  (Margolin  (1969)). 

Theoren  C3:  Given  n  (a  power  of  2)  and  k  >  n  =  n/2,  a  tr (L)-optinal  2V:-? 
design  in  n  runs  is  tr(L J-optinsal  among  all  two-level  foldover  (n.k)-designs  if  and 
only  if  r  (the  remainder  upon  dividing  k  by  n)  is  0,  1,  2,  n  -  1,  or  r.  -  2. 

Proof:  We  shall  consider  only  the  case  k  2  2  (nod  4 )  in  detail.  The  argument  for 
the  other  cases  is  similar.  As  noted  in  the  proof  of  Theoren  C2,  the  value  of  tr(L)  for 
optimal  fractional  factorials  is: 


5 

£ 


I 

'i 

s 

£ 


Eft¬ 


s' 


f  1 


tr(L)  =  n(k(k-1  )/2  -  n2’ 


where  n2  is  the  number  of  two-letter  words  in  the  defining  relation.  Since 
same  as  the  number  of  pairs  of  completely  confounded  factors,  we  car  refer  to  the 
construction  of  Section  3.2  to  obtain 

n^  =  r(  a-1  )a/2  *  (ii-rlal  a-i )  ?2 

f 

=  (k-r) ( r*k-n)/2n 

where  a  and  r  are  defined  by  (3.1)  and  (3.2).  Substitution  :r.3'  into  wo 
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(C.4) 


tr(L)  ■  k2 ( n- 1 )  -  r(n-r) 

for  the  ontimal  fractional  factorials.  These  designs  are  necessarily  foldovers,  sinco 
n  <  2k  (Section  3.1).  Wo  now  refer  to  Table  2.1,  which  gives,  for  the  case  V.  S  2 

**w 

(mod  4)  and  n  even) 


tr(L  )  ■  k2(n-1)  -  2(n-2)  (C.5) 

* 

where  L  is  the  lack-of-fit  matrix  for  an  optimal  foldover.  Equations  (C.4)  and  (C.5) 
are  the  same  iff  r  ■■  2  or  r  ■  n-2.  Similar  arguments,  appliod  to  the  cases  k  2  0,  1, 
or  3  (mod  4)  yield  Theorem  C3. 


Appendix  P.  "Minimum  Aberration"  As  A  Supplementary  Criterion  for  Choosing  Among 
Tr(L)-  Optimal  Fractional  Factorial  Designs. 

Fries  and  Hunter  (1979)  introduced  the  concept  of  aberration  as  an  extension  of 
resolution  in  classifying  2^  P  fractional  factorial  designs  according  to  their 
confounding  properties.  Let  ( n1 ,  n2  ,  . . .  ,n^)  be  the  word-length  pattern  for  the  2V'"C' 
design  i.e.,  n^  is  the  number  of  words  of  length  i  in  the  defininq  relation. 

Similarly,  let  (n^ 1 ,n2 1 , , . . ,n^’ )  be  the  word-length  pattern  for  another  2^"^  design 
Dj.  Then  D1  has  lower  aberration  than  D2  (which  we  express  by  D1  <  D2)  if  and  only 
if  there  exists  J  such  that  rij  -  n  ^ ,  j  -  1,2,...,J-I  and  n^  <  nj' .  Clearly,  if  D1 
n2  and  02  <  Dj,  then  D ^  <  Dj,  so  the  concept  of  aberration  may  be  used  to  rank 
designs.  The  best  designs  under  this  criterion  are  the  minimum  aberration  desiqns:  P1 
a  minimum  aberration  design  in  a  given  class  if  there  is  no  dr.sinn  D  in  such 
that  D  <  .  This  criterion  is  consistent  with  the  more  familiar  "maximum  resolution" 

criterion  but  is  much  more  sensitive  to  differences  in  the  structure  of  the  altasinn 
(confounding)  relationships. 


>/  i 
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We  recommand  the  use  of  the  minimum  aberration  criterion  to  supplement 
tr(L)-  optimality  whan  choosing  a  2*'”^  design  to  datect  tha  praaance  of  interactions. 
Minimum  abarration  designs  appear  to  bo  good  with  respect  tot 

(i)  maximizing  the  number  of  dogroes  of  freedom  q  for  two-factor  Interaction*,  and 
(ii)  distributing  the  k2  •  k(k-1)/2  interactions  ovenly  over  the  q  strings  of 
completely  confounded  interactions. 

We  shall  consider  the  cases  n  >  2k  and  n  <  2k  separately, 
jn  >  2k. 

The  tr (L)-optimal  2  p  designs  are  precisely  those  of  resolution  >  4.  In  thin 
case,  we  are  unable  to  prove  a  direct  relationship  between  minimum  aberration  and  (i)  and 
(ii)  above,  but  the  following  results  may  be  useful  for  those  who  wish  to  explore  the 
matter  further.  Let  h^  be  the  number  of  two-factor  interactions  that  appear  in  exactly 
i  of  the  n4  4-letter  words  in  the  defining  relation,  i  *»  0,1,..., n..  Then 

Ihi  -  k2  -  k(k-1)/2 
(Iihi)/6  -  n4 

Jh  /(i+1)  “  a  ( D. 3  ) 

Average  (string  length)  *  k^/q  (0.4) 

2 

Average  ((string  length)  )  »  (k2+6n4)/q  .  (D.5) 

If  we  note  that  the  number  of  strings  of  length  i+1  is  h^/(i+1),  these  results  are  all 
straightforward .  One  conseouence  of  them  is  that,  among  designs  with  the  same  degrees  of 
freedom  for  interactions  In),  the  minimum  aberration  design  distributes  the  interactions 
"evenly"  among  the  n  strings  by  minimizing  the  dispersion  of  the  string  lengths,  where  we 
define  dispersion  to  he  the  sum  of  squares  deviations  from  the  average. 


(D.1) 


(D.2) 
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n  <  2k. 


The  tr(L)-optimal  2k_p  desians  in  this  case  are  foidover  designs  of  resolution  2, 


having  ti :  fewest  possible  words  of  length  2  in  their  defining  relations.  (Appendix  C. ) 


The  aliasing  relationships  for  suci  a  design  include  n  =  n/2  strings  of  two-factor 


interactions,  counting  the  one  which  is  completely  confounded  with  the  overall  mean.  If  we 


define  the  length  of  each  such  string  to  be  the  number  of  two-factor  interactions  in  it, 


then  the  average  string  length  is  obviously  k^/n.  The  following  lemma  provides  a  formula 


for  the  average  squared  string  length. 


lemma  PI.  In  a  2k-P  foidover  design  of  resolution  2,  the  average  squared  length  of 


the  n  strings  of  two-factor  interactions  is  tk(k-1)/2  +  6n4  +  2(k-2)n2)/n,  where  n4 


and  n2  are  the  number  of  4-  and  2-letter  words,  respectively,  in  the  defining  relation. 


Proof.  Let  be  the  number  of  four-letter  words  that  include  i  and  j,  and  let 


nj_.  be  the  number  of  two-letter  words  that  include  i  or  3  (but  not  both).  Then  8^ 


will  be  confounded  with  exactly  n^  +  n^_,  other  two-factor  interactions,  and  the  length 


of  the  string  that  includes  8..  is  n..  +  n)  +1.  Now  let  v„  be  the  number  of 

13  ij  % 


interactions  which  are  in  a  string  of  length  i.  Clearly,  v^/L  is  the  number  of  strings 
of  length  l,  and  the  sum  of  squared  string  lengths  is  £  i2(v  /?.)  =  £  (n.  .  +  n'  +  1), 


i  i3  *3  *3 

where  the  second  summation  is  over  all  pairs  1  <  i  <  j  <  k.  Since  each  4-letter  word  in 


the  defining  relation  contributes  one  unit  to  each  of  6  different  n^'s,  I  nij  = 

r 

Similarly,  I  n^ .  =  2(k-2)n7,  and  the  lemma  then  follows  directly. 
i3  13 


Since  k,  n2,  and  n  are  all  fixed  in  the  class  of  tr (l)-optimal  2K  p  designs 


with  n  <  2k,  this  lemma  shows  that  the  minimum  aberration  criterion  here  is  equivalent  to 


minimizing  the  dispersion  of  the  lengths  of  the  strings  of  two-factor  interactions.  (This 


holds  true  even  if  we  omit  the  string  which  is  confounded  with  the  overall  mean,  since  the 


length  of  that  strinq  is  fixed  at  n->.) 

The  construction  of  minimum  aberration  tr(L)-optimal  2k-r>  designs  when  n  <  2k  is 


facilitated  by  the  following  theorem. 


Theorem  D1.  Let  D  =  [D/.D_]  be  the  n  x  k  design  matrix  of  a  2''~D  fractional 
"  ~  'V1  .~2 

factorial  design  (n  <  2k)  such  that  D  consists  of  a  >  1  copies  of  the  columrs  of  the 

*  ~ 

saturated  design  D  of  resolution  >4  in  n  =  n/2  factors  and  n  runs  and  d, 

* 

consists  of  a  subset  of  r  distinct  columns  of  D  .  If  D,,  minimizes  the  dispersion  of 
the  lengths  of  the  two-factor  interaction  strings  in  the  class  of  regular  fractional 
factorial  foldover  designs  in  n  runs  and  r  factors,  then  D  has  mimmur  aberration  in 
the  class  of  tr(L)-optimal  2^-p  designs. 

Proof i  By  the  results  of  Section  3.2,  D  is  tr (L )-optimal  no  matter  which  r 

* 

columns  of  D  are  chosen  to  form  Dj.  Now  consider  the  strings  of  two-factor  interactions 

m  the  aliasing  relationships  of  D.  If  we  ignore  all  interactions  involving  the  factors 

in  D_,  the  string  that  is  confounded  with  B.  will  have  length  na(a-1)/2,  and  each  oc 
~2  0 

~  2~ 

the  remaining  (n-1)  strings  will  have  length  a  n/2.  Now  consider  all  interactions  of  the 

form  f).  ,,  where  x,  is  a  factor  in  D.  and  x.  is  a  factor  in  D_.  For  fixed  i, 

ig  i  ~l  3  —2 

there  are  na  such  interactions,  a  of  them  in  each  string.  If  we  do  the  same  for  all 

r  i's,  and  include  these  interactions  in  the  aliasing  relations  for  D,  the  2^-  strirs 

will  have  length  ra  +  na(a-1)/2  and  each  of  the  remaining  strings  will  have  length 
2~ 

c  =  ra  a  n/2.  The  only  interactions  we  have  ignored  so  far  are  those  that  involve  two 
factors  from  D2>  If  we  finally  include  these  m  the  aliasing  relations  for  D,  we  will 
add  c^,  say,  to  each  string  length,  i  =  1,2, ...,r>,  where  the  c-'s  are  the  str’ia 
lengths  for  the  (n,r)-design  alone.  The  dispersion  of  the  string  lengths  (excludin': 

the  60-string)  is  therefore  the  same  in  D  as  it  is  m  d?.  If  the  choice  of  r? 
minimizes  this  dispersion,  then,  by  the  remark  after  Lemma  D1,  D  has  minimum  aberrano- 
in  the  class  of  tr (L)-optimal  2s  p  designs  and  Theorem  r>l  is  proved. 
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Appendix  E.  The  Approximate  Distribution  of  the  Likelihood  Ratio  Statistic  for  Testina  th*1 


Hypothesis  of  '■ ,  Interaction,  When  the  Interactions  are  Drawn  From  a  Normal  Distribution, 


and  a  Tr(L)-Optimal  Fractional  Factorial  Design  is  Used. 


This  Appendix  provides  back-up  material  for  Section  4.3,  which  gives  the  results  o*  a 


power  study  conducted  under  the  assumption  that  the  "true"  iteractions  (B  ’s)  are  drawn 

i  j 


independently  from  a  normal  distribution  with  mean  0  and  variance  o. 


We  restrict  this  discussion  to  tr(L) -optimal  2k~p  dsigns  in  n  runs.  If  wi  is 
the  value  of  the  contrast  in  the  observations  which  estimates  the  i—  string  of  confounded 


two-factor  interactions,  the  likelihood  ratio  statistic  w  for  testing  ~  £  in  the 


model  (1.4)  is,  for  o  "known". 


h  2  2 

w  =  n  w./o 
u  1 
i=1 


where  q  is  the  number  of  such  strings.  (The  string  of  two-factor  interactions  that  is 


confounded  with  BQ  is  not  included.) 


Under  the  assumed  normal  distribution  of  the  interactions  and  the  assumption  of 


normally  distributed  errors  in  (1.5),  the  w^’s  are  independently  +  c  /n)  where 

Z^  is  the  length  of  the  string  associated  with  The  mean  and  variance  of  w  are 


therefore: 


2  2  2 

E (w)  =  nS.o^/o  +  a  =  np  S./k_  +  a 
lb  '  I  4 


V(w)  =  2  V(nZ.o2/o2  +  I)2  =  2(n2p4F,/k2  +  2no2F  ,/k„  +  a) 

.ID  2  2  •  2 


?  ?  2  2  2  2 

where  S.  =  )_  Z.,  S  =  )  Z.,  and  p  =  k_o,/o  .  When  Z  =  C  for  all  i,  w  is 

■  .  .  l  2  .  .  i  2  b  i 

i=1  1=1 


2  2 

distributed  as  (nZp  /k^  +  1)x^.  Although  the  Z.’s  are  seldom  identical,  thev  are 


generally  quite  close,  especially  when  the  choice  among  tr(L)-optimal  designs  is  made 

using  the  minimum  aberration  criterion  as  recommended  in  Section  3.2.  We  would  therefore 

2 

expect  the  distribution  of  w  to  be  well  approximated  by  that  of  w'  =  ,  where  g1 

2 

and  $2  are  chosen  so  that  the  mean  and  variance  of  w*  match  those  of  w  given  in  (E.2) 
and  (E.3).  This  approximation  was  the  basis  for  the  power  study  discussed  m  Section  4.3. 


If  k  is  a  multiple  of  n,  i.e.,  k  =  mn,  then  nm(m-1i/2  interactions  will  be 

confounded  with  Sq  and  the  remaining  ones  will  be  distributed  equally  among  q  =  n-l 

2  2  2  2 
strings.  Thus  =  i  =  k  /n,  so  w  is  distributed  as  (k  o  /k  +  Dx^  <  which 

2  2 

approaches  (2p~+1)x~  as  k  *  “.  Using  t^is  as  an  approximation  for  the  distribution 

n-i 

of  w  when  k  is  large,  we  find  that  the  power  will  be  P  when 
2  2  2 

p  =  (x  /X_  ~  D/2.  This  result  was  used  to  find  the  "minimum  detectable"  value 

n-1;o  n-1;P 

of  p  for  large  k  in  (4.3). 


Appendix  F.  Tr(L) -Optimality  Under  a  Replication  Restriction 


Consider  the  construction  of  a  tr(L) -optimal  foldover  design  under  the  restriction 

that  n  rows  of  the  n  x  k  half-desian  0  are  replicated  once,  where  n  <  k  +  n  .  From 
e  '  e 

the  discussion  in  Section  2,  wo  see  that  the  problem  is  the  same  as  that  of  choosing  the 

~  -  ~  -> 
k  x  n  matrix  A  and  the  k  x  (n-2n  i  matrix  B  so  as  to  minmize  tr(DO'  !  where 

e  ~  e  — 

D '  =  (Al A'S] .  If  k  H  0,  1,  or  3  (mod  4)  this  problem  is  solved  simply  by  choosing 

(A*B;  to  be  the  design  matrix  of  a  tr(L j-optimai  half-design  in  k  runs  and  n  -  np 

factors.  This  can  be  verified  bv  notinc  tvat  the  inner  product  oc  any  pair  of  columns  of  O’ 

will  then  have  its  lowest  possible  magnitude  (0  or  1),  except  for  the  n^  pairs 

corresponding  to  the  required  replicated  columns.  Tf  k  I  2  !mcd  4),  the  solution  is 

slightly  more  complicated.  We  construct  )A^Pj  by  augmenting  a  column-orthogonal  matrix 

with  two  rows  (a^'Ib^*)  and  (a7*!p  ' chosen  so  that  laa^’a^  *  f^'b^l  4  1.  (If 

n-n  =  k  or  n-n  =  k-1,  two  such  rows  will  ha'"1  be  removed  instead.  See  Case  3  of 

e  e  - 

Appendix  B. )  It  can  be  verified  that  O'  will  then  have  the  maximum,  possible  number  of 


pairs  of  orthogonal  columns,  by  Ehlich's  (1964)  Lemma  3.4.  The  inner  product  of  any  of  the 
remaining  pairs  of  columns  of  O'  will  achieve  its  lowest  possible  absolute  value  (2), 
except  for  the  n&  pairs  corresponding  to  the  required  replicated  columns. 

Once  the  matrix  O'  has  been  constructed,  we  simply  transpose  it  and  fold  it  over  to 
obtain  a  tr(L)-optimal  design  subject  to  the  restriction  that  ng  of  the  foldover  pairs 
be  replicated.  In  practice,  care  is  required  only  when  '<  =  2  (mod  4);  for  all  other 
values  of  k,  the  procedure  is  equivalent  to  replicating  any  nfi  foldover  pairs  of  a 
tr(L) -optimal  design. 
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